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10.0 INTRODUCTION 


This unit is concerned with the approximation of certain “ well-behaved” functions 
of one real variable by polynomial functions which exhibit a particular pattern. It 
discusses the question: given a function f and its image and derivatives at a point a 
in its domain, what can we say about the image f(x), where x is “near to” a? 


The unit introduces the general Taylor approximation of degree n for a function f 
which possesses derived functions, f’, ”, f, ..., f. This approximation expresses 
f(x) as a polynomial of degree n in (x — a), with coefficients which involve only real 
numbers and the derivatives of fat a. 


The core material begins by discussing the linear Taylor approximation (i.e, the tan- 
gent approximation) and the quadratic Taylor approximation. The pattern which 
emerges leads us to consider the general Taylor approximation of degree n. We find 
that, knowing f(a), f’(a), ..., a) f"*", we can say something useful about f(x), 
where x is “near” a, This leads us to discuss what we mean by “ near” i.e. the validity 
of the Taylor approximation. In section 10.1.4 we discuss the error in the tangent 
approximation and give an expression for the error bound, and indicate the error 
analysis for the general case. We find that, in many cases, to stay within a particular 
error bound we have to place a restriction on x. 


The optional material falls into three main parts. 


In sections 10.2.1 and 10.2.2 we take up the discussion of iterative methods of solving 
equations, and we answer some of the questions raised in our discussion of iterative 
methods in Units / and 2. In section 10.2.1 we consider sufficient conditions for the 
convergence of an iterative method. In section 10.2.2 we consider a particular iterative 
method, called the Newton-Raphson method. 


In section 10.2.3 we extend our earlier work on the convergence of infinite series and 
consider power series, that is, series of the form 


dy + a,(x — a) + a,(x — a)* + a(x — a)? ++ 
The convergence of such a series usually depends on the value assigned to the 
variable x. In section 10.2.4 we consider Taylor's series and its convergence. 


Finally, in section 10.2.5, we return to the problem of the location and determination 
of the local extrema of functions of two real variables. We use Taylor's series (for 
one real variable) to derive a test for the determination of the nature of these extrema. 
(See Unit 7, section 7.1.7, Note c(4).) 
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10.1 CORE MATERIAL 
10.1.1 The Tangent Approximation 
(a) Purpose 


To explain how a differentiable function f of one real variable can be approximated 
in the neighbourhood of a point a in its domain by a linear function whose graph is 
the tangent to the graph of fat a. 


(b) Set Book 


Read section 2.5.0 (p.115), Study section 2.5.1 (pp.115-119) and complete Exercises 
1 and 2. 


(c) Notes 


(1) We met the geometrical interpretation of the derivative of / at a as the tangent 
to the graph of fat a in section 1.8.2 (pp.177-178). 


(2) Let ¢ be the tangent approximation to f about x = a; i.e. 
tix-——+ f(a) + (x — a) f(a). 
Then the derived function of t is 
ts x-—> f(a). 
Hence 
(a) = f(a) @ 
and 
(a) =f"(a). (ii) 
Conversely, let ¢ be a linear function, 
tix-——+bo+hx (xeR). 


Then ¢ is the tangent approximation to fat a if the graph of ¢ passes through the 
point (a, f(a)), ie. 


1(a) = by + bya = f(a), (i) 
and the slopes of the graphs of f and t at a are the same, i.e. 

(@) =b, =f"). (ii) 
From equation (i), we have 

by = f(a) — bya; 


hence, from equation (ii) it follows that t is the function 
t:x-—+ f(a) +f" (a(x — a) (xe R). 
This result is in agreement with Equation (1) on p.118. 


(The importance of this approach stems from the fact that it can be generalized 
to derive higher order polynomial approximations. We shall consider these in 
sections 10.1.2 and 10.1.3.) 


We have seen that equations (i) and (ii) completely determine the tangent ap- 
proximation to f about x = a, and conversely. 


(3) If tis the tangent approximation to f about x = a, then 
in (f@) — x) = f(@) — t(a) = 0, 


by equation (i). 


4) 


MST281 10.1.1 


Also, 
lim2 = 1x) _ tim? —Sf(a) — (x - a) f'(@) 
xva X—-@ xa x-a 
= inF=L0 _ pg 
=S'@)-f'@) 
=0. 
We now have the two results: 
lim (f(x) — 1(x)) = 0 (iii) 
and 
mL) = 1) (x) — 1) a0) (i) 


xva X—@ 


Conversely, if t is any linear function which satisfies equations (iii) and (iv), then, 
from equation (iii), it follows that 


S(a) = t(a), 
since f and ft are continuous at a. 
We may write equation (iv) in the form 


tim £22 =L@ = (Hh) = a) _ 0, 


x0 xa 
ie. 

Limf2=L@ fo, m (2) = 1) =0; 

xva X— elie x-a 
hence 

S'(@) = t'(a). 


Hence t is the tangent approximation to f about x = a. (See Note (2)). 


Consequently, ¢ is the tangent approximation to f about x =a if and only if 
equations (iii) and (iv) are satisfied. (Again, these results can be generalized for 
higher order polynomial approximations.) 


Equation (iv) gives us an upper bound on the difference | f(x) — t(x)| between 
the actual value of the function f at x and the approximate value given by t(x), 


when x is “near” a, Because lim—————— fo =H) = 0, then, for x sufficiently near a, 
xa 
If) - tx) 
|x-al 


(otherwise the limit could not be zero). Hence 
If@) — t)| <|x-al, ) 
for x sufficiently near a. 


If we define the error in the approximation at x to be the difference | f(x) — t(x)|, 
then inequality (v) gives an upper bound on the error, provided x is near a. 
In the special case when we consider the tangent approximation to fabout x = 0, 
inequality (v) becomes 


IPG) = 1)| < |x|. 


Of course, the phrase “* x sufficiently near a” is very vague, but errors in approxi- 
mations will be considered more rigorously in section 2.5.6. 
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(d) Self-Assessment Questions 
1 Derive an expression for the error in approximating the function 
fix xP (xe R*) 


over an interval [a —6,a+6]©R* by the tangent approximation at the point 


(a, f(a). 
2 Derive an expression for the error in approximating the function 
1 
Si x-— i (xe R*) 
over an interval [a — 5, a + 6] R* by the tangent approximation at the point 
(a, f(@). 
3 Use your results for questions 1 and 2 to show that, in each case, 


i f 
error <4|x—al? x ( maximum value o! ). 


[f"Q)| in [a - 5, a+ 5] 


Solutions 


1 The derived function of f is 
S1x— 3x? (xe R*), 
so the tangent approximation at (a, f(a) is 
tix-——+ a? +(x—a)3a”_— (xe R*), 
The error in the approximation is 
Ife) — t(x)| = [22 — a? — (« = a)3a?}. 
If x € [a — 6, a + 4], then we can write x =a +e, where ¢ € [—6, 5]. Thus 
error = |(a + 8)® — a’ — ¢3a| 
= |3ae? + &°| 
= |3a + ele”. 


2 The derived function of fis 
’ 1 + 
fixe z (xe R*). 


As in question 1, we can write x = a + 6, where ¢ € [—6, 6]. We have 
error = | f(x) — «(x)| 
1 Le ¢ 
G+) aa 
e 
(a + 8)a® 


3 (i) In question 1, 
Sf" 1x — 6x (xe R*), 
so 
maximum value of 
slx—al* (ipl e+ 8) 
is 
4e? x 6(a + 6) = (3a + 35)e”. 
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From question 1, 
error = |3a + ele? 
< [3a + |e||e. 
Since 5 > 0, and |e| <6, it follows that 


f 
erore diy al? x () maximum value ot ). 


f"(x)| in [a— 5, a + 4) 
(ii) In question 2, 
fis (xe R*), 


so 
maximum value of 
ale —aP x (pt) ine e+ )) 


2° *G-a Go 


From question 2, 


error = 
a 


a(a— 6)" 


Since 5 > 0 and a > 0, it follows that a?(a — 6) > (a — 5)°, and therefore 


maximum value of 
error < j|x— a)? x ( ) 


[£"@O| in [a 6, a+ 5])° 
(©) Terminology 
Defined in this section: 


linear Taylor approximation (tangent approximation) 


(f) Additional Exercise (OPTIONAL MATERIAL) 
Use the tangent approximation to compute the following values: 
(i) (25.018)'/? 
(ii) sin 29° 
Solution 
(i) We use the tangent approximation t to f: x ———+ x"? about x = 25, 
Then = 
tix ——<+4 /25 + (x — 25725) (xe R*). 


Now 
1 


Tan 


fi :x— 


and so f’(25) = 1/10. 


Hence 
tix —+ 5 + A5(x — 25) 
and 
#(25.018) = 5 + +45 (0.018) 
=5+0,0018 
= 5.0018 


((25,018)'? is 5.017997 correct to 7 decimal places.) 
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ii) sin 29° = sin (0 — 1)° = sin ("--). 
(ii) sin 29° = sin (30 — 1)° = sin « aa) 
We use the tangent approximation ¢ to f: x ———> sin x about x = 2/6. Then 


tix-—> xin(?) + (« - £)oos(Z) (xe R) 


6, 6, 6, 
ie. 
1 n\ /3 
to t——n 3 + (« x z) age 
whence 
(5-2) =} apa 
6 180) 2 180) 2 
= 0.4849 


(sin 29° is 0.4848 correct to 4 decimal places.) 


10.1.2 The Quadratic Taylor Approximation 


(a) Purpose 


To explain how a twice differentiable function / of one real variable can be approxi- 
mated in the neighborhood of a point a in its domain by a quadratic function q, 
dependent only upon f(a), /’(a) and f"(a). 


(b) Set Book 


Study section 2.5.4 (pp.122-124) and complete Exercise 1. Ignore the first two sentences 
of this section for the moment. (The relation between the iterative method and the 
linear Taylor approximation is discussed in the Optional Material, section 10.2.1.) 


(c) Notes 


(1) Instead of regarding the quadratic Taylor approximation as the limit of a quad- 
ratic through three equally spaced points (as we have done on p.123) we can start 
by requiring that the quadratic function 

qi X-—+ by + by(x — a) + bx(x—a)? (x R) 


satisfies the conditions specified in Equations (1) (p.123). The derivation then 
follows that given, and is clearly a simple generalization of that given in section 
10.1.1, Note ¢(2), 


The equations 


(a) = f(a) i) 

g(a) =f'(a@) (ii) 

q"(a) =f"a) (iii) 

completely determine the quadratic Taylor approximation to f about x = a, and 
conversely. 


If you are interested in establishing the equivalence between the geometrical and 
algebraic interpretation of the quadratic Taylor approximation, then you can 
study the method described in section 2.7.7, page 228, to fit a quadratic to the 
points (a, f(a), ((a + h, f(a + h)) and (a + 2h, f(a + 2h)). The required quadratic 
is given by Equation (5), page 229, where x, = a, %4, =a + hand y%,4, =a + 2h. 
Taking the limit as approaches zero, and using the definitions of f’(a) and f"(a), 
it can be shown that Equation (5) on page 229 reduces to the quadratic Taylor 
approximation. This demonstrates the validity of the intuitive argument given 
on page 123. 


(2) 


(3) 


MST281 10.1.2 


If q is the quadratic approximation to f about x = a, then it can be shown that 
lim f(x) — q(x) = 0 (iv) 
a= e o 
ava X-@ 

LS) — a) 


0 (vi) 


Conversely, if g is the quadratic function which satisfies equations (iv), (v) and 
(vi), then it can be shown that 


qi x+-—> f(a) + (x — a) f(a) + A(x - a)? fa). 
Consequently g is the quadratic Taylor approximation to f about x =a if and 
only if equations (iv), (v) and (vi) are satisfied, 


Equation (vi) gives us an upper bound for the error | f(x) — q(x)| in the quad- 
ratic Taylor approximation. 
Since 


fim2 29) 


xa (x—a)? “ 


then, for any small positive number e, it must be possible to find a positive number 
6 such that 


L(x) — a(x) 


(=a? 


whenever x € [a — 6, a + 6]. 


Hence 

If) — gx) <6] xa? 
Taking ¢ = 1, we have 

If@) - 9@)| <|*-a)?, 
for all x sufficiently “ near” a. 


(d) Self-Assessment Questions 


1 
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Derive an expression for the error in approximating the function 

Six— +x? (xe R*) 
over an interval [a — 6, a + 6] ¢ R* by the quadratic Taylor approximation at the 
point (a, f(a)). 
Derive an expression for the error in approximating the function 

1 

fix—+ : (xe Rt) 
over an interval [a — 6, a + 5] S R* by the quadratic Taylor approximation at the 
point (a, f(a)). 
Use your results for questions 1 and 2 to show that, in each case, 


maximum value of ) 
[f()| in [a — 6, a + 5))° 


Calculate an approximation to (1.14)!/? by 


1 3 
error <3; |x-a| ( 


(i) the tangent approximation; 

(ii) the quadratic Taylor approximation, 

Compare your answers with the correct value, which is 1.067708 (correct to 6 
decimal places). 
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Solutions 
1. The first and second derived functions of f are 
S' 1x+-—> 3x? (xe R*), 
SJ": xX —+ 6x (xe R*) 
respectively. 
The quadratic Taylor approximation at (a, f(a)) is 
qix-—>+ a + (x —a)3a? + 4(x—a)*6a Ss (xe R*). 
The error in the approximation is 
If) — g@)| = |x? — a? — (x — a)3a* — (x — a)?6a). 


If xe [a — 6,a + 5], then we can write x =a +e, where ee [—6, 5]. The error 
then becomes 


|(@ + 8)? —a* — 03a? — 42*6a| = |e|°. 


2 The first and second derived functions of f are 


fix -3 (xe R*), 
“ 2 + 
fiix—— + (we R*) 
respectively. 


The quadratic Taylor approximation at (a, /(a)) is 
1 ae 2 
qix-—+ 7 (ea) tae ay (xe R*). 


The error in the approximation is 


(We a! 1 Ak 
Sage) — (x - a) ar 


f(x) — q@x)| = 


If xe [a — 5, a +6], then we can write x =a +e, where ¢€ [—6, 5]. The error 
then becomes. 


2 Cans | 


Ja+e|" 


é 
a 


BD) a er 
aan 43-4\= 


Se 
a+é aoa a 


3 (i) In question 1, 
SLO:x-— 6 — (xe R*), 
so 
maximum value of ) 


1 3 
geal (pontine ba 
slo]? x 6= fel? 

Hence, in this case, 


error = ft |x —al? x maximum value of 
“31 f%Cx)] in fa — 5, a + 3))" 


(ii) In question 2, 


SO rx—— -§ (xe R*), 


=al? x maximum value of 
[F@)| in [a — 6, a + 3] 


4 


1, 6 a 


6° “*@—5* (@—a* 


From question 2, the error is 


Since 6 > 0 and e> — 4, 
a@(a+e)>(a—8)*, 
hence 
1 3 maximum value of 
error << = |x-al? x (ye fe Gina a} 
if 
Six-—+ x? (xe R, x #0), 


then the tangent approximation about x = 1 is 
tixe—— > 1+h0-1) (xe R, x #0), 
whence 


11.14) = 1 + 400.14) 
=1+0.07 
= 1.07 


The quadratic Taylor approximation about x = | is 


-1)? 
qix-— fl) +8 = pry + 25" prop, 
Now 
1 
J 2—— san (xe R, x #0) 
fiix— — on (xe R, x #0) 
and so 
(= -4 
giving 
qi xX—+ 1+ d(x - 1) - f(x - 1), 
(1.14) = 1 + $0.14) — 4(0.14) 
= 1+ 0.07 — 0.00245 
= 1.06755 
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We see that the quadratic Taylor approximation is more accurate for this value of 


x than the tangent approximation. 


(e) Terminology 


Defined in this section: 


quadratic Taylor approximation 


(f) Additional Exercises (OPTIONAL MATERIAL) 


1 
2 


Use the quadratic Taylor approximation to calculate an approximation to cos (31°). 


Find the quadratic Taylor approximation to the function 
Six-— 3x*-x4+6 (xe R) 

about the point x = —1. 

What do you notice? 
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Solutions 
i) aa'cos (eee) 
1 cos (31°) = cos ( + ial 


Let 

Sf i: x-—> cos x (xe R). 
Then 

Sf':x+-—> —sinx (xe R) 


Sf": x-—+ — cos x (xe R) 


and so the quadratic Taylor approximation about x = z is 
H+ («Hr +36-)G) 
rx f(s —=)s' (=) += (x-=)s’%(- 
me 6) * 6)! Ne) Ta 6)? NG, 


a(S *) 3 x 1 Bees 


6 * 180) ~-2 ~ 180“ 2~ \igo) “4 


Thus 


ud n 
a(z + im = 0.8572 


(to four decimal places) and in fact this is the correct value to four decimal places. 
2 We have 
Six—+3x?-x+6 (xeER) 
Six -—— 6x - 1 (xe R) 
S'ix-—_—+ 6 (xe R) 


so the quadratic Taylor approximation about x = —1 is 


2 
qix-—— f(-D ++ D/(-D + Gt mn 


ie. 
1 
qix—+ tort n+ eto 
i.e, 
x— + 10 — 7x — 7 + 3x7 + 6x +3 
ie. 


xH— 3x7 -x4+6 © (xe R). 
This is the same as the original function. 
This should come as no surprise because both f and g are quadratics with 
f(-I)=a-) 
f(-)=a(-)) 
fXe1) = a=) 
and as we observed earlier, equations (i)-(iii) in Note c(1) completely determine 
the quadratic approximation. 
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10.1.3 The General Taylor Approximation 


(a) Purpose 


To 


explain how an n-times differentiable function f of one real variable can be approxi- 


mated in the neighbourhood of a point a in its domain by a polynomial function of 
degree n. 


(b) 


Set Book 


Study section 2.5.5 (pp. 124-129) and complete Exercises 1, 2 and 3. If you are short 
of time, omit Exercise 2 and all but the last part of Exercise 3. 


© 
100) 


Q) 


G) 


(4) 


(@) 
1 


Notes 


The geometrical interpretation of the general Taylor approximation is analogous 
to those of the tangent and quadratic approximations, (See Note c(2) in section 
10.1.1 and Note c(1) in section 10.1.2.) If a polynomial is fitted to the function / 
at (n + 1) equally spaced points 
a,a+h,a+2h,...,a+nh, 

and the limit as 4 approaches zero is taken, then the expression obtained for /(x) 
is the Taylor approximation of degree n. Since the manipulation involved in 
this derivation is very tedious, you are advised not to attempt to derive this 
result for yourself. 


Note that the Taylor approximation of degree n is characterized by the equations 


P(a) = f(a) 
Pa) =f'@ 
pa) =f"(a) 


Pa) = fa). 
The Taylor approximation of degree n satisfies these equations and, conversely, 
any polynomial of degree n which satisfies these equations is the Taylor approxi- 
mation of degree n. (See Note c(2) in section 10.1.1, Note c(1) and Additional 
Exercise 2 in section 10.1.2.) 


It can be shown that 


tim £0 = PO)! _ 9 (k = 1,2, 


+) n), 
ave [x—al* 


where p(x) is the Taylor approximation of degree n. This follows from the 
(n + 1) equations listed in Note (2) above. 


Exercise 3 and its solution (p. 129 and pp. 148-150) brings out two important 
points. First, for some functions the Taylor approximation is exact if n is large 
enough. If 


Six -—— (ax + by" (xe R) 


(néZ*), then the Taylor approximation of degree n about x = 0 is in fact the 
binomial expansion of (ax + b)". (See Unit 2, section 2.3.3.) 


Second, for some functions the Taylor approximation about the point a is only 
reasonable within a limited neighbourhood of a. We must examine carefully the 
extent of the region in which we can use p(x) as an approximation to f(x). 
This point is taken up in sections 10.1.4 and 10.2.4. 


Self-Assessment Questions 
Let / be the polynomial function 
Six-— x — 5x? - 2x44 (xR). 
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Find values of the constants ¢g, ¢,, C2, C3 such that f may be specified in the form 
Sf :x-——+ C9 + (x — 2) + n(x — 2)? +03(x-2)8 (XE R). 


2 Derive an expression for the error in approximating the function 
I 
fix— (xe R*) 


over the interval [a — 6, a + 5], a> 6 > 0, by a Taylor approximation of degree n. 


Solutions 
1 We have 
fix ax — 5x? -2x+4  (wER), 
S's x —+ 3x? — 10x — 2 (xe R), 
Sf": x— 6x — 10 (xe R), 
LO: x-—_ 6 (xe R) 
L™:x-—+ 0 (xe R),n>4. 


This means that the Taylor approximation of f about any point a in its domain 
terminates after four terms. So the required expression is the Taylor approximation 
of degree n > 4 about x = 2. Hence 


Co =f (2) = —12 
¢ =f") = -10 
=4f"Q)=1 
3 =4fQ) = 1. 
2. The derived functions of f are 
1 
Peper ee (xe R*), 
fiz 5 (xe R*), 
GO ee (xe R*) 
ve 
fsx AS? (xe R*) 
forse WEY (xe R*). 


Hence the Taylor approximation of degree n about a is 
1 joey 2 
PAX) =F A at 5 — ays 


3x2 
a 


u 3 eA ty 2 gp te 
= FOr a) 4 (1 - a Se 


Let x = a + 6, where e € [—4, 5]. Then the required error is 
1 tl -6 os ts 
h-G-#t3--+Crz)| 


1 
Great Ja"** — (a+ e)a"+(a+e)a"‘e 


fee (-1Ma + el 


If) — Pad] = 


ola 


= (@+oa""* 
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The maximum value of | /*"(x)|, x € [a — 5, a + 6], is 


(n+ DM-1y""! (n+1)! 
(a—6y"*? | * (a+ e)an*) 


Hence 
error = & = alee 
~ (a+ ea"*t 
i eee maximum value of 
<a al * (\peetanintand.a-+) 


We shall see in section 10,2.4 that this result, which we have obtained for a special 
case, holds for any function f with continuous derived functions of orders 1, ..., 
n+l. 

(e) Terminology 

Defined in this section: 


general Taylor approximation of degree n 


(f) Additional Exercise (OPTIONAL MATERIAL) 


Additional Exercise 3 (p. 144) provides an opportunity to revise the ideas discussed 
in this section. 


10.1.4 Error in the Tangent Approximation 


(a) Purpose 

To discuss an estimate of the error involved when a differentiable function fis approxi- 
mated by the tangent approximation in the neighbourhood of a point a in its domain, 
and to state (without proof) Taylor’s theorem for the tangent approximation. 

(b) Notes 


(1) In sections 10.1.1-10.1.3 we have defined the error in an approximation as the 
quantity 


|exact value — approximation]. 

In this section the error is defined as the signed quantity 
approximation — exact value, 

and its negative 
exact value — approximation, 

is called the correction to the approximation. 


(2) From the self-assessment questions in section 10.1.1, we have already found the 
error in the tangent approximation for two simple functions, and we have found 
an expression which gives an upper bound on this error. The aim of section 2.5.6 
is to extend this result to the general Taylor approximation. 


(c) Set Book 
Study section 2.5.6 (pp. 130-134) and complete Exercises 1 and 2. 


(d) Notes 


(1) The result given on p. 131 (Inequality (1)) corresponds to the result which we 
established for two particular cases in the self-assessment questions of section 
10.1.1. This is the statement of Taylor’s theorem for the tangent approximation, 
namely that, if 


sO] <B (tela, x), 


16 


Q) 
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then 
1C,@)| = |) —£@ — (& - a)f'@| < 4a -a)B. 


We shall demonstrate the validity of Taylor’s theorem for this particular case. 
(Taylor’s theorem for the general nth degree polynomial approximation is dis- 
cussed in section 2.5.7.) 


Let us consider the case x > a. We define the function 
Cit-—-fO-Y@+t-@f'@] (tela, x). 
The first and second derived functions of C, are 
Cyit-—+f()-f'@ (te [a x), 
Cite Sf") (t € [a, x]). 
Suppose that there exists a positive number B such that 
If"O|<B (te fa, x). 
Then, since Cj(t) = f"(t) and Ci(t) < |C{()|, we have 
Ci) <B (te [a, x}). 
We now integrate the above inequality from a to s, where s € [a, x]. We obtain 


[i — + crn< f: —e: 


By the Fundamental Theorem of Calculus (Unit 5), it follows that 
Ci(s) — Ci(@) < Bis — a), 
since C', is a primitive of C{. But Ci(a) = 0, so we have 
Ci(s) < B(s — a). 
Since this inequality holds for all s in [a, x], it follows that 
Ci) <Bit—a) (te [a, x). 
We now repeat the procedure and reduce the order of the derivative one further. 
Integrating this inequality from a to s, we obtain 


fi — ci <[/ ——+ Bt —a). 


By the Fundamental Theorem of Calculus, we now have 
Cy(s) — C,(a) < 4B(s— a)? (se [a, x). 
C,(a) = 0, so we have 
C\(s) <4B(s— a)? (se [a, x). 
Similarly, starting with —C{(t) < |C{(t)| < B, we could obtain the inequality 
—C\(s)<4B(s—a)? (se [a, x). 
It follows that 
[C\(s)| <4B(s—a)? (se [a, x). 


A similar demonstration applies for x <a. The general Taylor theorem may be 
demonstrated similarly. (See section 2.5.7.) 


The fact that we can place an upper bound on our error does not imply that the 
error is small. When we use the tangent approximation in a particular case, we 
must find the value of this upper bound in order to see if the error is acceptable. 
(See Example 1, p. 132.) 


Notice, however, that, since the error bound depends upon the quantity (x — a)?, 
we can make the error as small as we please by restricting x to a region close to 
the point a. 


17 


(3) Note that our result gives an alternative proof of the statement 


tim FQ) = 1091 _ 


=0. 
xa = [x—a| 
(See section 10.1.1, Note c(3).) 


For 
|£@) = #)| = Cx) 
and therefore 
2 
‘Om If) — 1) <lim $B(x — a)? | 0. 
xva |X —a| xva |X—a| 


(e) Self-Assessment Question 


Additional Exercise 4, section 2.5.9 (p. 144) provides practice in using the Taylor 
theorem for linear polynomial approximations to estimate the error in a linear 
approximation. 


(f) Terminology 
Defined in this section: 


error in an approximation 
correction to an approximation 
Taylor's theorem for linear polynomial approximations 
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10.2 OPTIONAL MATERIAL 
10.2.1 The Convergence of an Iterative Method 
(a) Purpose 


To give a necessary condition for the convergence of the sequence generated using the 
recurrence formula 


Ue = Flug) (Kk = 2,3,4,--)5 
where u, is an approximate solution of the equation 
x = F(x), 


and to discuss the conditions under which we can use such an iterative process for 
solving equations of the form 


S(x) = 0. 

(b) Note 

We started to consider the problem of solving equations of the form 
f(x) =0 


in Unit ] (section 1.2.4, pp, 32-37) and Unit 2 (section 2.2.4, pp. 32-35). If you did not 
study these sections, then work through them before attempting to complete the 
work below. For convenience, we shall start this section by summarizing the results 
obtained so far. 


Given the equation f(x) = 0 with domain the real interval /, we define the function F 
by 

F:x-— F(x) =f(x) +x (xe /). 
We saw in section 1.2.4 that the following conditions ensure that F(x) =x has a 
solution in an interval [a, b] < J; 
(i) F has domain and codomain [a, 6]; 
(ii) Fis continuous on [a, 6). 


In section 2.2.4 we considered how to select a form for f(x) = 0 so that the sequence 
generated by iteration using the corresponding function F converges to a solution of 
JS (x) = 0. We found that, if Fis a linear function, then the sequence converges provided 
that 


|the slope of the straight line graph of F| <1. 


In the following material, we shall extend this result to a general function F. We shall 
then go on to consider the problem of selecting the interval [a, 5] so that it contains 
only one solution of the equation f(x) = 0. 


(c) Set Book 
Study section 2.5.2 (pp. 119-121) and complete Exercise 1. 


(d) Notes 


(1) Notice the distinction between necessary conditions (conditions which must 
hold if u does have a limit), and sufficient conditions (conditions which ensure 
the existence of a limit for the iterative sequence). 


(2) Strictly speaking, the necessary condition produced takes it for granted that the 
function F is “ well-behaved”, that is, it is the kind of function to which it is 
reasonable to apply the tangent approximation and which satisfies the conditions 
imposed in Note (b) above. All these requirements are certainly met if we assume 


Q) 


(4) 
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that Fis differentiable throughout its domain; however, this condition is stronger 
than we need, as we show below. 


In section 1.2.4 we examined two forms of functional iteration for solving the 
equation x? — 2= 0, We can apply our test for convergence to these sequences. 


In problem 3 (p. 34), we examined a functional iteration based upon 
Fixx? -24+x (x € [—24, 14). 

The corresponding derived function is 
Fisx-—> 2x +1 (xe [—24, 14). 

We have 
|F(—/2)| = |A-/2 +1] > 1, 


so the iterative sequence will not converge to the root at =/2 (and this is the 
only root in the interval [—24, 14). 


In Exercise 2 (p. 35), we examined a functional iteration based upon 
F 14% (well, 14) 
ix $5 5 
ss ee J 
The corresponding derived function is 


F':x-—— 


(xe [I, 14). 


We have 

IFC/2)| = |-4+4] =0<1, 
so the iterative sequence will converge to the root at Ni 2 (and this is the only root 
in the interval [1, 14]). 


In section 2.5.2 we do not indicate how to obtain a sufficient condition for the 
convergence of the functional iteration. Our discussion in Units ] and 2 shows 
how to tackle this problem, We must find a condition which ensures that there is 
only one solution in the interval [a, 5]. How can we find such a condition? 
What form will it take? 


If F is differentiable on [a, b], then one condition that will certainly meet our 
requirements is 


|F'(x)| <1 for all x € [a, 6), 


where [a, 6] is an interval on which F satisfies the conditions imposed in Note 
(b) above. This condition is certainly satisfied by a linear function with slope 
between —1 and +1 which we considered in Unit 2, section 2.2.4. 


We can establish our assertion as follows, 
Suppose | F’(t)| <1 for all te [a, 6]. 
Then we may write F’(t) < | F’(1)| <p, where pe R and 0 <p <1, 
We now integrate the above inequality from a to x, where x ¢ (a, b]. We obtain 
x 
fro ross rp. 
a a 
By the Fundamental Theorem of Calculus (Unit 5), it follows that 
F(x) — F(a) < p(x — a). 
Putting x =~_1, F(uj-1) = and F(a) = a, we obtain 
Uy — @ < Puy, = a). 
Hence we obtain 
uy —a<ps'(u, —a), 
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and convergence is established, since 


lim (4 — a) =0 
large 


(because lim p* = 0, see section 3.2.1). 


k large 
How do we use this result? The approach is as follows. 
Given an arbitrary equation f(x) = 0, sketch the graph of f'so as to obtain some 
idea of the values of the solutions of the equation. Set up an appropriate function 
F so that it satisfies the following conditions: 

(i) Fis differentiable on [a, 4); 

(ii) | F’'(x)| <1 for all x € [a, 6); 
(iii) F(x) € [a, b) for all x € [a, 5). 


The iterative sequence will then converge, as required. 


10.2.2 The Newton-Raphson Process 


(a) 


Purpose 


To obtain an approximate method for solving the equation /(x) = 0, 


(b) 


Set Book 


Study section 2.5.3 (pp. 121-122) and complete Exercise 1. 


© 
(a) 


(2) 


Q) 


Notes 


The method described is appealing on intuitive grounds for clearly if we are 
“ sufficiently close” to a solution of f(x) = 0, then the graphical interpretation 
(p. 121) suggests that the Newton-Raphson method will converge. (All the 
“steps” in the iteration are trapped" between the curve, the tangent at the 
initial point, and the solution.) However, the derivation tells us nothing about 
the nature of the convergence, nor does it tell us how to find a starting value for 
the iteration which is sufficiently close to the solution we are seeking to ensure 
convergence to this solution. We consider this problem below. 


Another problem comes to light if we examine the form of the recurrence 
formula, 


— flu) 

SU) 
Clearly we shall encounter problems if f’(1) is zero at one of the points 4. 
When will this occur? We have seen in section 1.8.2 that /'(u,) = 0 implies that 
the tangent to the graph of f is parallel to the x-axis at the point 4,. If we are 
already close to a root, then geometrically we can interpret f'(14) = 0 as implying 
that /(x) = 0 has two, or more, solutions close to the point x = u,. By sketching 
appropriate curves for yourself, you should be able to see that, when the tangent 
to the graph of f is parallel, or nearly parallel, to the x-axis, then the linear 
approximation cannot be used to solve f(x) = 0, because it can lead to a value 
of x for which |u, —x| is very large. 


Une = UK 


In theory, the Newton-Raphson process can be used if 4 is close enough to a 
solution of f(x) = 0, and it will fail only if the equation has two or more coinci- 
dent solutions. In practice, you are likely to encounter serious computational 
difficulties if the solutions are simply “close” rather than coincident. 


We now consider the problem of selecting a satisfactory initial approximation. 
The method to be used is the same as that used for the functional iteration 
problem. That is, we seek conditions on the function f that will enable us to 
identify an interval within which the initial approximation must lie. The labour 
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involved in establishing the appropriate conditions is considerable, and thus not 
appropriate to our introductory course. However, the intuitive meaning of the 
conditions are simple and straightforward, so we shall state the conditions to be 
satisfied, and give some explanation of their significance. 


Let f be a function which is defined and has continuous derived functions, 
f', f", on an interval J ¢ R. This condition ensures that f is sufficiently ‘* well- 
behaved” for us to be able to use the quadratic Taylor approximation to discuss 
the behaviour of the terms of the sequence which is generated by successive steps 
in the Newton-Raphson process. 


Suppose that the following conditions are also satisfied on an interval [a, b] < J. 
(i) f(a) f(b) < 0; that is, f(a) and f(b) have opposite signs. 
(This condition ensures that there is at least one solution of f(x) = 0 in 
{a, 6].) 

(ii) f'(x) #0 for all x € [a, 5). 

(This condition, taken together with condition (i), ensures that there is only 
one solution of (x) = 0 in [a, ].) 

(ii) Either 

S'(x) 2 0 for all x € [a, 5] 
or 

f(x) <0 for all x € {a, 5]. 
(This condition ensures that /’(x) is either increasing or decreasing through- 
out [a, 6], which in turn enables us to show that the terms of the sequence u 
are such that either 4 >t-, or uy <t-1, thus forming a steady pro- 
gression of closer approximations to the limit.) 

(iv) If c denotes the end-point of [a,5] at which | /’(x)| is smallest, then 
FAC) 
IfO| 
(This condition ensures that the tangent to the graph of fat the end-point 
intersects the x-axis within the interval [a, b].) 


<b-a. 


Under this set of conditions, the Newton-Raphson method converges to the 
(only) solution of f(x) =0 in [a,6] for any choice of initial approximation 
x, €[a, b]. 


These conditions are sufficient but not necessary; convergence can be established 
for weaker sets of conditions. In practice, to use this result we must first sketch 
the graph of f and use it as a basis for selecting an interval which we can then 
show satisfies the conditions specified. 


(4) One final point: although we derived the Newton-Raphson formula by a dif- 
ferent technique to the basic functional iteration method (described in Unit 1, 
section 1.2.4), it does not represent a radically different idea. If you compare the 
solution of Exercise 1 of section 2.5.3 (p. 146) with Exercise 2 of section 1.2.4 
(p. 35), you see that the iteration formula which we established in both cases is 
identical. This observation underlines the fact that we can use many different 
methods to set up an iterative process to solve the equation f(x) = 0; for example, 
we would obtain yet another formula if we were to approximate the graph of /, 
near to a solution, by a chord rather than a tangent, and so on. 
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10.2.3. Power Series 
(a) Purpose 


To explain what is mean by a power series and the sum of a (convergent) power series, 
and to give the (convergent) Maclaurin expansion of some standard functions. 


(b) Note 


We introduced the concept of an infinite series and defined the meaning of the sum of 
a convergent infinite series in section 3.2.3 of Unit 3, We advise you to revise (or work 
through) that section before studying the material specified below. 


(©) Set Book 


Study section 2.5.8 (pp. 139-144), and complete the exercises, (You completed Exer- 
cise 1 when you studied section 3.2.3 in Unit 3.) Omit Exercise 4 if you are short of 
time. 


(d) Notes 
(1) In section 3.2.3 of Unit 3 we dealt mainly with infinite series that did not contain a 
variable. The exception was the geometric series 
ltrtrete 
We have seen that this series converges to the sum 1/(1 — r) if |r| <1 and that it 
diverges if |r| > 1: that is, the convergence depends on the value of the variable r. 


In section 2.5.8 we discuss this more general type of infinite series in which a 
variable element is involved, The series 
Ay tayx+aax?+... (xe R) 

is called a power series, because it is composed of powers of the variable x. When 
a fixed value is assigned to x, the power series reduces to the type of infinite 
series discussed in Unit 3. Thus a power series may be convergent for some values 
of x and divergent for other values of x. Since the sum of a convergent power 
series depends on x, it is denoted by S(x) to show that it is a function of x. 


(2) Exercise 2, and its solution (pp. 141 and 153-154) illustrates the link between the 
Taylor (Maclaurin) approximation discussed in section 10.1.3 and the mathe- 
matics of infinite series, 


If the function f has derivatives of any order, then the result of Exercise 2 tells 
us that, if the power series 
L(@) +f (Ax = a) + Af"(ax— ay +e (xR) 
has the property that lim C,(x) = 0, then it converges to f(x). 
ki 


large 


We call such a series the Taylor series (expansion) for the function fat the point a; 
if a is zero, then we call the series the Maclaurin series (expansion) for f. Some 
examples of Maclaurin series are given on page 143. It can also be shown that, 
if the power series 


bo + by(x = a) + byx(x — a)? ++ 
converges to f(x), then the series is the Taylor series for fat the point a; that is 


u 
= aro. 
(C.f. Note c(2) of section 10.1.1 and Note c(1) of section 10.1.2.) 


(3) In section 3.2.5 of Unit 3, we discussed the problem of summing infinite series, 
and described some simple tests for determining whether a particular series is 
convergent or divergent. The techniques described there can be applied to the 
problem of summing power series. We see from Note (2) above, that we may 
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be able to obtain the sum of the series directly (by recognizing f) if we can 
establish that the series is absolutely convergent. We would like to be able to 
determine the values of x for which a given power series is absolutely convergent. 
For simplicity, we can consider a power series in the form 


Ay tax + a,x? 4°", 
since the more general form 
by + by(x — a) + bx(x — a)? ++ 
can be regarded as a power series in the variable 
X=x-a, 
We can obtain a test for absolute convergence by making use of the ratio test 
described in section 3.2.5 (f) of Unit 3. We consider the ratio of two successive 
terms in the series. The result to be used can be stated as follows: 
If the series 
Cy + eg +3 +°"" 
is such that c,+,/c, is defined for all n and 
Sota 
Cn 


lim 
nlarge 
then 


L, 


if L <1, the series is absolutely convergent; 

if L > 1, the series is divergent; 

if L = 1, the test gives no information about the convergence of the 
series. 


If we apply the ratio test described above to the power series 
Ay + aX +agx7 +56", 
then the condition for absolute convergence is 


| a, 

lim | 4] |x| <1, 

niarge| Oy 
where a, # 0. 


If there exists a number r > 0 such that }a,x" converges absolutely for |x| <r 
and diverges for |x| >, then r is called the radius of convergence of the power 
series, and the interval ] —r, r[ is called the interval of convergence. Notice that 
the ratio test leaves us with an open interval, since the test is inconclusive when 
|x| =r. The behaviour of the series for x = +r requires separate investigation. 
If the series is absolutely convergent for al/ values of x, then the radius of con- 
vergence is said to be infinite. 

(4) In section 2.5.8, we have used an alternative criterion to establish convergence, 
based on the result of Exercise 2 (pp. 141 and 153-154); we examine the values 
of x for which 

lim C(x) = 0, 
k large 


where C,(x) is the correction to an expansion. This test gives us the results 
summarized on page 143, To apply this result, we often make use of the estimate 
for C,(x) derived in section 2.5.7. 


(e) Self-Assessment Questions 
Investigate the convergence of the following power series: 


ye 3e 
a 
cre aed 
fea 13 
Seiwa Aa 
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x? 3 
Sie oot ay he! 
eee 
Aeros e Tite 

Solutions 


2 
1 The series is a geometric series with common ratio — a4 


The series is absolutely convergent if 
is = 
-=|<1 ie. xe]—./2, /2L 


If x = +,/2, the series is divergent. 
2 The nth term in the series is (—1)"*'x"/n. Using the ratio test, we obtain 


A 4, * n 
lim |—**}|x| = lim Ix! 
niarge| &y niarge 1+ 1 
n 
= |x| lim —— 
| ea n+l 
= |x|. 


Therefore the series is absolutely convergent for |x|< 1; that is, the radius of 
convergence is 1. For |x| < 1, the series is the Maclaurin series for the function 


fix-—+In(l+x)  (ve)—1, 1D. 
It can be shown that the series converges for x = | and diverges for x = 


3. The nth term in the series is x"~'/(n — 1)! 
Using the ratio test, we obtain 


tim | 921 |)<) = tim =! |) 
mlarge| ny niorge nt! 
= |x| lim = 
mlarge 7 
= |x| x0 
=0. 


Therefore the series is absolutely convergent for all values of x. 
The series is the Maclaurin series for the exponential function. 
4 The nth term in the series is (—1)"*1x?"~!/(2n — 1)! Using the ratio test, we obtain 


¢, . Qn-1)! 
Hira) 22* |S tim : 
ell seo es oreon a 
= 21im ——— 
Vl" Tima aan + 1) 
= |x|? 0. 


Therefore the series is absolutely convergent for all values of x. 


The series is the Maclaurin series for the sine function. 


(f) Terminology 

Defined in this section: 
power series 
Taylor series (expansion) 
Maclaurin series (expansion) 
radius of convergence 
interval of convergence 
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10.2.4 Taylor’s Theorem 
(a) Purpose 


To demonstrate Taylor’s theorem; that is, to show that the condition 
\f°"%O| <B (te [a, x) 


is sufficient to imply that the correction associated with the Taylor expansion of a 
function / at the point a satisfies the inequality 
B 


aa 
Il <a sal". 


(b) Set Book 
Study section 2.5.7 (pp. 134-138) and complete Exercise 1. 


(c) Notes 


(1) The method used to demonstrate the general Taylor theorem is a simple general- 
ization of that used to demonstrate the Taylor theorem for linear approximations 
(section 10.1.4). 


(2) Remember that the importance of this theorem is that it enables us to estimate the 
maximum error involved when we approximate a function by a Taylor (or 
Maclaurin) expansion. 

(d) Self-Assessment Question 

In the Maclaurin approximation of degree n for f: x + e*, how large does n 

have to be for the error in the approximation for e¢ to be less than 0.001 ? (Assume that 

e = 2.71828...) 

Solution 

e* increases steadily as x increases, and f(x) = e* for all x. So in the interval [0, 1], 

LOM <e. 

It follows that 


—§__ 4 ott 
error = CD SG +p! (1 — 0)’ 


_ 2.71828 
“+I! 


We find that, if we take the Maclaurin approximation of degree 6, and substitute x = 1, 
the error in the value we obtain for ¢ is less than 0.001. 

(e) Terminology 

Defined in this section: 


Taylor’s theorem 
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10.2.5 Maxima and Minima of Functions of Two Real Variables 


In this section, we return to the problem of the determination of local extrema of 
functions of two real variables, which we introduced in Unit 7, section 7.1.7. We use 
the Taylor series for a function of one real variable to construct a test which enables 
us to determine the nature of such extrema in certain cases. 


So far in this unit we have written the Taylor series about x = a in the form 
Sx) = fla) + (x — a) f"(a) + Ha - ap f"(a) +>", 


that is, as an expression for f(x), where x is “near” a particular point a. We now wish 
to use this result in the more general form 


LOX +h) =f(%) + WF) + PP) Ho 
that is, as an expression for the image under f ** near” the general point x. 


Let F be a real function of the two real variables x and y, We shall assume that F has 
continuous partial derivatives of order 1, 2, 3, 4 with respect to x and y (alone or com- 
bined). 


We define F(a, 5) to be a local maximum (minimum) value of F(x, y) if 
Fla +h, b +k) — Fla, b) 
is negative (positive) for all small independent values of A and k. 


We now use the Taylor series for a function of one real variable to investigate the 
sign of F(x + h, y +k) — F(x, y). We do this by treating F as a function of each real 
variable in turn, the other variable being held constant. This means that the derivatives 
in the Taylor series will be partial derivatives. (See Unit 7, section 7.1.4.) 


We shall adopt the following notation. We shall denote 


OF 
Fi(x, y) or = by F.C, y)s 
OF 
F,(x, y) or ay by F(x»), 
; or 
Fix, y) or 3 by Fal, Y) 
‘ or 
F4,(X, ») or AR by F(x, »), 
’ OF 
Fi2(x, y) or ap ox by Fyx(x, 0), 
, oF 
Fas(%, y) or 5 by Fay(% ¥), 
and so on. 
The conditions which we have assumed F to satisfy are sufficient to ensure that 


Fry = Fy: 


We begin by considering y and & as constants and treating F as a function of x alone. 
Using the Taylor series, we obtain 


Fx th yth=Fay+h +h lx y+ +i Ry thee. @ 


We now treat x as constant, and treat F as a function of y alone. Using the Taylor 
series, we obtain 


F(x, y + k) = F(x, y) + KF (x, y) + ARAF (x, y) +o (ii) 
We now take equation (ii) and replace F by F, to give 
F(x,» +k) = FAX, y) + KF yl, Y) + HP Fy XY) Hoo (iii) 
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Similarly, replacing F in (ii) by F,,, we obtain 
Figg, Y +k) = Foal, ¥) + bE pra, Y) + 4K? FyyelX, Y) + 07+ (iv) 
Substituting equations (ii), (iii) and (iv) in equation (i), we obtain 
F(x +h, y +k) = F(x, y) + KE, y) + AEC, y) 
FAK F y(t, y) + ARF (265 Y) 
+ YPF(x, Y) +0 
Thus 
F(x +h, y +k) — F(x, y) = KE,(x, y) + hF (x, y) 
+ APF (X,Y) + Wk F(X, y) + AF e(X,y)) +00 
Now, if A and k are sufficiently small, the sign of 
F(x +h, y +k) — F(x, y) 
is the sign of 
KF,(x, y) + AFA, ¥). 


The last expression changes sign with the signs of / and k, so a necessary condition for 
(a, 6) to be a local maximum or a local minimum is 


KF,(a, b) + hF(a, b) = 0 for all h, k; 
that is, 
F(a, b) = F,(a, b) = 0. 
When this condition is satisfied, the sign of 
F(a +h, b +k) — F(a, b) 
is the sign of 
K?F,,(a, b) + 2hkF,,(a, b) + h?F,,(a, 6). 


Thus, for a local maximum or minimum, this expression must have the same sign for 
all small values of h and k. Writing 


A=F,(a, 6), 
B= F,,(a, 6), 
C= F(a, b) 


and completing the square, we obtain 
B\? _ (AC—B’) , 
Al(k&+4n) +( re a }.440. 


The sign of this expression is the same as the sign of A, provided that AC — B? > 0 
and h and k are not both zero. 


Let us assume that AC — B? > 0, that is, 

Fy,(a, b)F,,(a, b) = (F(a, 6))? > 0. 
Then ‘ 

Fa +h,b +k) — Fla, b) > 0 if F,(a, b) > 0 
and 

Fla +h, b +k) — F(a, b) <0 if F(a, b) <0. 
Thus we have the following test: 
If (a, b) is such that 

F(a, b) = F,(a, b) = 0 
and 

Fyy(@, b)Fex(a, b) — (Fy x(a, b))? > 0, 
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then 
(a, 6) is a local minimum if F,,(a, b) > 0, 
(a, b) is a local maximum if F,,(a, b) <0. 
Note that, by symmetry, the last two lines may be replaced by 
(a, b) is a local minimum if F,,(a, b) > 0, 
(a, 6) is a local maximum if F,,(a, b) <0. 
This is the form of the test given in Unit 7, section 7.1.7. 


MST281 10.2.5 
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MST281 10.3 


10.3 SUMMARY 


In this unit we have considered the Taylor approximation in some detail. 


When you have completed work on the core material, you should be able to write down 
the general Taylor approximation to f(x) about the point x = in the domain of f, 
for a suitable function f, You should also be able to give an upper bound on the error 
when the tangent approximation is used. 


The optional material extends the work of earlier units. 
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